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ABSTRACT 

Research on aedia and technology in education appears 
in Wny foras and styles. The results of this research so far has 
been quite disa:»oointing, in that researchers have failed to point 
out the difference between research on aedia and research vith aedia. 
research also has tended to becoae highly specific^ thus losing 
{Representativeness. A conflict between better control over specific 
variables and representativeness could be solved by so«e new research 
aethods. In field studies a pseudo-experimental design or a staged 
innovative design allow research to be conducted in naturalistic 
surroundings. In strictly experiaental studies the rotation design 
and the ecological design can be used. The aajor theae of th^se 
techniques is to aove media research out of its traditional either 
internal-or-external validity conflict toward better and aore 
fruitful research. 
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Introduction 



Resciirc'a on uiadia aud technc.l£;?,y in education covers a vide and diverse 

also 

r.uvu- of ini,irS^f:^in^i1^;xiins. Its ciethodolor.ii'bAvary fron basic 

, field . ■ 

.e>:perir.KM,tnl vork ili^^t.bornrory throunhAexperirH-.ts in educational 

. institulioi.s, to lai-j;f ^calc evaluations of programs and products 
i„ current u.e by sclu,ol«. ^ ^^^^^ ^; ^^^^^ .nnhodnlor^y can accurately cover 

this raxigc» nor can the field be -ade unif.u-m to fit some arbitrary conception 
of THE best approach to I'cscarch. 

Howcv. r, underlyini; t!.is diversity there are conunon research objective's 
which &uide the field and allow us to classify diverse studies, such as those 
resultina system's approach, together with studies of one vs. two 

channel inputs, under the hondinj:; of tnedia research. Three n.ajor objectives of 
media research can be identified. The first is to obtain knowledge about the 
educational or instructional effectiveness of a chosen wcdiuir.. or technology. 
Researchers who cmphasi'/.o this objective aM.oropt to answer the question of 
"how can various nedia best be used for instruction?" (OarM 197A) . Typical 

of sucli dttex;pts is the comparison between U^o media, or between alternative 

(e.g. Allen and Wointraub, 1968). 
vennons ot thi same medium^ Other studies, in ;^hich the specific merit of 

a particular attribute or technique associated with a medium are investigated, 

can bo inclu .1 liere. 

Tlic second objective of niodin research is to increase our undorstandin- 
of l>ow r.icdia and techncvIoi;y function, and what psychological effecls they 



ha.i on U-anui.,. Th.T. is, of course, rcl.-.tcd io the previously 

«K.utionod one, but diiivv^ frcun it in one rcsiu-cL: Iv is jnorv- couoenud 
wilU how m-.dia tunctiun iuiycholonio:^ny thnn uUh how ef fective they arr-. A 
i.Luay by Miller and Iks (1972) that invest ir.ntod the provoking and cnr,ar4nc 
characterlst Lcs of CAT is tyoi rat of this r.oal. 

: The third objective of media rcr^onrch is to improve the practice of - 

education threui;h the provision and evaluation of better materials, ircdla, 

procedures and tcchaolosics. The evaluation studies of Sesame Street (Ball 

6, lJor,at:r. 1970; Ro^atJi & Ball, 1971) are exanple.s o£ such studies. 

It heconxs evident that r.iost researchcrR aim at more than one objective. 
Fur exaraple, the above tiientioned study by Miller and Hess va.s deninned not 
only to ftain better understandinr, of the tnotivat ional functions of CAT.» but 
al80 to co;)ipare experimentally the .nothods of increasing the enr,n}:cn,ent of 
learner?? in the program. The latter is an attempt along the lines of the 
first type, of objective mentioned above. Similarly, Van de Boiiart (1972) 
wade a case study of a serlea of television similation presentations and 
evaluated it. He also atten.pted to reach some more general conclusions t^hich 
could be applicable to other cases. Do ins so. he aimed at both our first 

and third objectives. 

It would appear that such diverse studies , often aitiring at more than 
one objective, carried out over more than half a century, would yield 
valuable prac =al and theoretical results. Thi.-, however, seems not to 
be the case. Hecent summaries of and comments on n^edia research unanimously 
agree that media research has, in fact, yielded very little (Scattler, 19G8; 
Snow U .Salu.;on, 1968; Gordon, 1969, 1970; Allen, 1971; Jamison. Suppos & 
Wells, 197/*; and others). Olson (1974) co:im,e.nted on the accuniulated research 
on media by statinp, that — 



"We Uuo\^ m'ithfr'^lo ckr.oribo iho in;yc\xo\ov.huil eCfcfts 
of ... tuchnoloRicn nor how to .ut.ipt tlu-w to the |>ui-pvJU'S 
oC education. ThciJj£il£nM^^ 

or u nknown" . : 
Indeed, it could bo b v.h. VvL, that the effects m^v^h^ noticonhlo is 
illustratod by research done on televlGion and ar.r.rcssion (Fuchs & Lyle. 1972). 
advertisement nnd children's consumer bch..vior (Liebcrt, Nealc & Davidson. 
1973) and the like. It. nc-cnis more likely that educ-.arionnl media research 
^ has failed to detect r,uch effects. Horc importnnr. U hns failed to explore ' 
ways of realising yet unexplored potejUiam^ .uedia, and converting 
them Lo educational purposes. We prefer therefon re-oxamine the develop- 
weutal trendn of n^edia research rather than blame the r.icdia then^selves. In 
the foilowina sections, major trendr- in past and present studies on media 
arc examined, and some methodoiosical suasestious are made. 

Inter-Media COiiipar^sons 
Only a few years ago, research was mainly cnuar.cd in attaining the goal 
of finding the best n'.edium or technology for instruction. This gave birth 
to a rather large nui^ber of intcr-^nedia comparisons, iriost salieiit of which 
were the nedium vs. facc-to-fac& studies. 

The typical question — is one medium (or technology, procedure, etc.) 
superior to another - appeared to be a rather straight f onward valid question 
to raise. However, as Kn.>wUnn (1964) attd Mielku (1968. 1971) have convinc- 
ingly shown, it was jjijjict an invalid question, leading to uninterpretable 
renulti;, if re.'iutlri v.'t^re obta!n*tl at all. 

Metlu.dolu,acal!y. a co.npari.-ion between two media calls for a ^^7ell 
controlled e>;port«'ent in which all variables, except a media variable, are 



hcia cuuM^nl. Tlur\Tmti :it Tt'^odo of ptosoiitat i OP , r^trurtiiic, dia,ictu r., 
3itualion, and iho liko novd lo bo eqmiH«ed bef.vci.n the o>:pcrimcnLaI 
Gonait lons. lu the typical in' vs. faci-to-faco cotnpari«c.n the dosir.n 
would be as folIouHi A U-ucher prcscnLr, the material in the facc-to-face 
■ condition (no ii.t tract: ion wUh slmlonis perndltcd to avoid a new variable' 
f ron: entcrrinc) vhilc another lironp of It-^^rners v.'aL.'hca the sane pre nea tat ion 
on a TV monitor. Conditions, indrcd, arc equal and only the medium o£ 
prof?cntatiou ir aljov.'cd to vary. 

Ho'.vVver» ar, MielUe (396») haM shown, if aU other variables have beau 
controlled for. what was left to vary? V-lMt. t!ien» wnK the inuepmidont 
vari ihU' who.se effects were ;;tiidlcd? All that remained to vary in such a 

study \^as the lerWIo^::^^ since, indeed, other things were 

■ • f ■ ■ ■■ ■ • 

equal. 

The only reasonable conclusion [of such a study] would 
be that the mediation, and the mediation alone, caused 
the significant differences in [sayl achievement (Miclke, 
1968) . 

But such differences \^ere rarely found. And if found, how could they 
be interpreted? The ansv.v-r ib offered by Gordon (1969): 

Most research in this area has been designed merely to 
measure the influence of technology (not mediums) upon 
academic grades, rather than determine the real difference 
bet\^een the n.odiums themselves. That these experiments 
have shown that the sajRie kind of tcacb.i ng operates more or 
or less the. same xjay with and without technological aids 
... might liave been anliclpatod before experimentation 
bot^an (p. 118) • 
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In jsUoit , vhfu only the U-a«t iiignir icaiif .uipi-cLs of insuucliiui are 
allov cd to vary, noU; Iiir, of inl<-rt-..i could, and dul» result. 

Rciicarch Witii and Kcicarch On Mt-dia 
, A siiuilar criticLinn applied to a corollary of the r.icdia-comparir.on 

stratcvt namely uhc....«tuUy- or...cl-a.f:f;roo.»| wa:via^'-A-»t, P^"^^^^^^^^^ 

^A^'^um-elau .5 to media. Yet, Ptudicri^ conc.-rucd witb active v». passive 
lc,afianf., inir.L'diate or delayed fee^iiiack to £.tudent.n (see e.g. Gay, 1972), 
jind the like, appeared aft_il dealinc with mtdin. Knowltoti (1964) has 

coimaeutod , en such studieri claiming that .if., say, overt active participation 

':.'J-^....,.:,.oV IcutucY^ has been found to enhance their learning,, why should if be any 
different v\m';\ filu is used? Indeed, no new knowledge was gained with 
respect to cither bureau learning or tho merit r. of film v.'hen research vij;h 
O'edia posed as if it wart research on media. 

There is a major dilfcrence of focus between the two. 

Whereas research ,wilh media only employs media as convenient devices for 
stimulus presentation or data collection, research on raadia involves 
inherent, qualities or attributeH of media as the major focus of investigation. 

\- • .• - ... . 

Research witli media differs from research on media not only in focus 
but also in approach. Research concerned with the management of learuinp, 
for instance — by presenting programmed materials on a TV screen (Carpenter 
1968), investigates a " natural" piven . Thus, Carpenter studied the tolerance 
of students to externally paced mterial, and Gay (1972) studied one's 
proi'.rcss v:ith immediate or delayed feedback when involved in difficult tar.ks. 
Research on media, on tlie other hand, need not be concerned with any avail- 
able r.ivon. Tl can cent e the most contrivc'd espcriences, extract the most 
creative potentialities of media, and study how Lhey affect le.arnlnj',, even 
If they are not typical of any existing instructional packajje. 

O 
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^^^^ ' , . , , ....:■'.!.. 'v..,. ■v...' ... ... u 

IHMlin.; witl/ vl.a nodfa or tcchnotcr- ' /N <{o, r-uUcir tl.zn v;it!» what 
uu.y i^aoitn; iupl l.. that p.n-M.ul.t uu-ai..: attribute:: at-c Klnolrd out 
.-^ind built into won construe Lc-ci c.:-:i>erim/.ntM conditiuus to .hov vbct effc-cl. 
.they h.v.. Thl. was done, for Jn.tnncc. by Solomon (IV72) who r.Ludlcd the 
uu.ntnl-^.«P,inntin^ functions of .,oci£i. fHuic t.ch.i.uc^ in int. race icn 

with individual difroa ncc:;. Such rtudlc:f^^V:id«a3 ly. rc-^ ac|^^ntor-,;vd Ja 

, ,. c„m;v.rlr.c.:u. ,aa cahcr lyp..^ of rt's^.^'irch vitl.. iK^dia. ns c.-n U- 

■■' wit„c:«ua Jn Jv5e & Wckl«'» v - of U.c fl.>U d"?). i»«to.-..l 

vvi«is foin^::in^» upon 

: . -of Bro.:s ,:...dia con.i..rt..cms, research ^^ivccIMc attribute: wl:or,c 

, \^c'rt' •. • ■ 

. iustructional potcntiulit.ic-. b.-iug invent i^.n ted. 

' The realization thr.t grosr. T;»edin ccw.parisous and research wUh 

n;cdS^^n'^«? ^.U. practical or theoretical valur to the 
field, van accompnnlod by A ior vnw. ecnceptuali.ation to replace the 
strict empirical a-<Lheoreticnl. appro.ch. Co.cepCMnl i.ation was expected 
to focur. rescarchoi-i^' attention to more v.-l 'd questionK • ov 

the ijlWouL ^-^-^-^^^ ^' ^'^^^^''^^ ^'^"^^ ^"^^''•'^ research in cheoretical 
cent ex cr.. 

Indeed, a number of researchern have 5:ugncHted vays to deal vith niedia 
in termr. of their Inherent attribules and derive new hypotheses from the 
analy^H^s oi! their merits (e.r... Tryluck f. Snow, 1^67; Salomon i. Snov, 1908; 
Snow. 1970; FredetiU-sen, 1970; Clarl:, 1?7A). 

It waij generally sucsostcd that attriiuiteH of media and technolo^^y be 
conceplu tH.:ed in Lcvms of their pHychelcr-ical er it.fw.ructional effectn and 
funcLionr-,, lather i!.rn in teru^f. of fb^r v-hyrAcril appearance. Thu^^, it 

could he fuund that a mm.bor of pir/s^ '.-ali.t 1 cally ditferent attributes of 
r^dia or tcchuolor-v i^.ve a hif.h probability of elicit inn similar re.ponr,e« 
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iu learuoi-n. By virtue- of r.I.nriui; a connmn offrct tn, loanuT^ ibc-y then 

could be r.roupoa loyylh.'V and In- com^'ptuany ircaloa ar, equivnlcnLi). 

Studici;. xvhich votaa sociu to chal x.'Uh cnt ircay JUCorczit cutili.-.s» iuich nr. 

pruftriuucii iatitruf-tion 
line. drawi:ii-..s and raiulcaly ordci'ca fra.n..« in tuxl. could be iound to 

* , 

bear upon ihc «am«. Ci.r.tiillon«, r-tu-h nr, (nny) n:.?;HmHc .«nccrcoint:y. 

ConccplualUatJou of mcdl.-. Mtributos -In ucnn^ of their p.ycholosical 
e£fcct£; and. lunction'j pointr. to a ^K-ldotn .n.ao aiHtlncUcn between rc-«earch 
concerned with pf.ycbolor.U«.a.l oniictB^, and nnu-arch concerned with 
Instruct ic^naL^qcH-X'riOllg^' '^'J'^' former aadrc.;r;c.s it:.elf to the information 
processing nctivitie.% mental or emotional states, brotu;ht about by 
different iv.vdia atir.ibute.s as they interact wit!, learners' p<.ychol oj;Jcal 
charactcrli;tics. Such research i« t..nfa typically found in the fields of 
pr.ycbolosy o^v.l cotnmunicntion. Ik-rlyne'r. v.ork (e.g. 1965) on the p^;ycholosical 
effects o£ cojnp-.cx, aiubiguous or a.symetrlcal sLiuull, and tho pr.ycholosical 
analyses of pictures by Conbrich (1974). are eKanple» of research on 
effects* 

Research on imaiuctional ef f cctivene::?: , on the other hand. ir. 
concerned with the contribution of some medin attribute to loarninp, in 
liiiht of tho dcmndB of a .-specific task. It is, of course, the irnditlonal 
dominion of educational research. 

It was the fusion of research on effects uith research on effectiveness 
which wa^ so badly needed for coneeptuali;<nt-ion to cmercn. Indeed, studies 
which point to psychological effects of nicdia attributes are hiebly 
sufiser.tive of hypothfses which point to the learning tasks for - * Ich the 
studied .iurlbutcr. cotild be ror-t effective. The sftdics of Samuels on the 
role of pictures in the acqui.-^jltjon proc.-^s of readinr, (Samuel . 1967; 1970; 
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r..i.auot:;, nic;Urud; i. Terry/ l«i74) illusirnto this jHunt. 

Mure j'.i-mr.jlly, kniHsMn;- v.-hat eiTi'cl a luodf of 5:Linml.-it J ha.-;, am! 
l,ov.' it interact- v.-ith cliff L-rcnf typcsj of Icanun'!;, akin un in ronprrluMi.! inn 
itr, r.orc fundatiu-utal nature. The tticdc of sf.lmulal Ion can then bo 
con.cciauali;u-vl in I .'r.us of U.; psycholor,i cal fund {ot. as warj done for iniitancc 
by Coii'.wy (196r>) v/itli recard to inultipK-vi''"""-'!- by O'lJoll (1<>7U) 

with rc'iiara to rir.ntive foedbnck in CAT courncn. A dctailud analysis of 
the snore f urdninental requirements of leariUnc tasks miaUt consequoutly tcU 
us the extent to which the documented effects become also instructional! y 
effective. 

That different media attributes may have different psycliolcnical 
effects on individual learners is quite self-evident. self-evident 

I* 

is the fact that lnBt^ct,i_c)nnl_^fjr^^ result of the 

iiUeractiqn of psycholo£;ical effects with the rcquirementc of the desired 
IcaruJni'. ontcosno. It becowes clearer, however, if we accept the idea that 
wedia or technology a'.tributcs facilitate learninr, to the e::tent that they 
activate, elicit or arouse in specific learners thoiio mental states and 
processes which are relevant to the rcquiroraents of the task (Salomon, 1974a). 
The hypotheses concernins differential learning outcomes which can be 
derived from recent work on concrete-stimuli and their imagery arousing 
effects (e.g., Paivio, 1971) exemplify this point. 

General iF.ations 

This r.hift froa gross media comparisons to studies in which interactions 
of media with leanicrs and tauks are sotir.ht implies that no overall 
generalizations of res.jlts, such as "CM is superior to programmed .texts", 
are fonnulaled. It also leads researi-h away from a strict trial-and-error 
empiricism and ir.to a more tonceptual realm. 



U if: 1'.ti ri-:ainu to nolo thnf .1 lu.itcil , ralhei: than total ccncniHr.atJonr.. 
woiv already stn.r.l't •«ftvr by the finu r.t'ner.it ion oC mtHlia rcf^cnrchors. 
rivt-man (192V, qaotcd by Sonttler, 196S) was apparcutly the firril to 
couatict a sysLcnintic series of CJiporiwentri with film. Onci of hiu conclusions 

followa; . ... 

Thu relative cf foctlvciU'sr. of voibal infstruoticjn art 
* couMMKtC'd witrb the various forms of concrete or realistic 
material in vir.ua.l meJia dcpcnda on the nature of tiie 
iufjtruction to be given and the character of the learner's 
previous experience with 'objective nntcrials (Seattler, 
196B. p. 116). 

It is unfortunate that the idea of interactions of media with learninfi 
ta.sks and learncra u'as lost, fiivlnr, way to studies which sought "the be.^t 
mediuju." 

LiiDitcd, rather than total,, generalisation of flndincs yield raorc 
incaninsful and wore logically acceptable results. Knox^lnf, hovi diverse 
Icarnera and tasks arc. and having noticed the widu range of messages and 
situations that nudia and technolo^jy can provide, it would be difficult to 
accept all^encoinpassing generalizations. (Snow (1973) maintains in this 

respect tb.at - 

Interactions limit genera ligation of treatment effects. 
If an important personal characteristic of learners is 
sampled too narrowly ... or if that characteristic is 
ignored . . . then gcncrnliJiation is rendered uncertain 
at l>e£;t and p.ntcntly wrong at worst (p. 8). 
The deHU." Interaction studies thus calls for a wide repYOsontntion 
of learn.'r^ and of liuiYiuny, tar.ks. Tn a study concerning motion in filnjs. 



ERIC 



com!uou,.a by A)t.-n .uul UV inirauh (1908)^ thi. the caso. Throe type', 
ul hMrn^na t.i.l:H vo.e «t«aU:..U and Si^.'i U^.ruors cllfferinr, In aRu, sex. 
ability and sp.cHic Unuwl.ar.c were tor.led. The researchers reacUud the- 
cuiuh>slcn th.-.t r:ot,hm in lilnui faci 1 il-nte:. loarninr. more than still. 

pictures. TlJ s r-oiu-ral i;ial (ot, appears to be warraiued tdnce thii^ wau the 

ca:.c rv^.nrd\c:^j^ of Uanicr or task cUCfcrcnces. Mote often. interactiouH 

arctuum! with either learners. LaBks. or both. tlemonsL rating that 

ec.ncraU::ationr. oa the ba.sis of restricted «amplc.. of learners or tanks 
arc unwarranted • 

In general, it minht be ^aid that a.-> media ^-^t-Uributes become better 
conccptu.ili^ed, better rationales are developed. Boii^cwhat better 
undert^tandini; of specific media functions can be gained, and :.^ra justified 
litnited uonereH.ation« are reached. Ceuerall.ntions of thin kind have 
recently been formul.ited by AHcn (1974. in prestr.) as a result of his 
GXtcnr-lve survey the literature. 

A l)l le»'.?.a 

Experimental work, as jur.t described, has recently gained increasing 
proiuincncc in the field of it.edia and technolor.y. However, th^ tnore it 
TOOved into the deeper layerr; of urxdcs^}.m^^ the farther away it 

went fron. the world of education.^ And in spite of its improved quality 
it neverthele:;s fell short of accot.pl ir:h1n« the objective of improving 

educational practice. 

There is a major rcaf.on for this failure. The research described above 
Is by norenf^ity hif.bly analytic and detached, ftu.f; it is - by Its very 



^ The reader i:s invited to compart, a 1963 cnnimary of n.edia Tcscarch 
(hu::usdalne. 196.0 with a fiinllar jntrvey pubUahed nim ye.irs later 
(hevio 6 IJlckle. 197:'). 



nature — uur.'prti.cuUatlve o\ flu- real \.ov\l\ of o.Uic.vllou. 

' One of the i;i.i.jor purposes oi rictH.i nM-.onrch In to ilvvpen uiulorsfaud! nj.'. 
of what funrl ion.s r.-divi nttrihiito.s can .•u:i:oinp1lNh lor dU furcnl Icnrnera 
ana diffcrt nl ta.-ku. I t mur.t: ciaphnfJlRiS f irst and f orrtnont » AntoiiKil 
v^naUj^'. If tlK' royiMrchcr wir.hcs to a.sciibe n particular effi-ct or 
Cunction Lu particular attribute-, ncnlucui^ of <->-pf>rlmenta I co:,.pnriHon ia 
ncct'Hr.arlly called for. Tli:is calln for caro fully arrnn[.Td cKi>t'rin:..-ats in 
which onbl t"^^^ ucHired varlaMoK are allowed to vary nccordinr. lo the 
researcher 'ti rnfioum c. Hovover, when r.Mch Ik carefully done according to 
the canons of Dcthoclolof^.y . Bonicfhins of utrK.r.t importance is loc^t, natnoly: 
represcntat Ivoncrs, or external validity. 

A number of rc-ccnt papers have b.-cn addrosycd to this issue (Bracht & 
Class, 1968; Shulman, 1970; Snov, 1973). Briefly stated, there is a constant 
compc.iion belvccn the control of variable... to allow accurate Infnrcncos, 
(emphanlr. on Internal validity), and i-cMir-ra] i. -lability of findings to real 
life settings (emphasis on external validity). Indeed, what could be 
gcnoralljied to the real world of instruction from an experiment in which 
cooperative students were shovjn experimentally manufactured stimuli and 
asked to learn experimentally designed materials under ideal conditions, 
introduced as a relaxing break in a tedious schoolyear? 

Acknowledginr, this, it is often argued that the research needs to be 
carried into the real education world and conducted with real matorialn and 
stimuli. I-oxall (1972) compared the re^itivn instructional effectiveness 
of radiovislon (tape recorded j-ouf.d track accompanied by a filmstrip) with 
television in a courj;e of new mat hematics. Kach medium of instruction wa« 
aJlowd to manifest all its nualitlcM. Thun. there were no time* limitations 



on the nuUovi sit.n, wlii 1c ni^ l il h.v;, a hu;as • f op.i; and tlu^ like wcrct 
allowvd. The Uc.lcvl:.;iou IM. u Mint !c.n, .m tlio n:iH-r h-nul, cunlaltH-d midi ^ 
animatioa huL aid not pcrmU ii:t c-rrui.t ionr;. No r.tyrunccml iUSU iwrnci 
ben^ccn the. grcnn.s v.nnv Couiul, U.adinc'to the concluslun that ri.Jlovi«io!i. 
which Jr., far lesa co.st.ly Ihnn iclcviiuon, lacilii.alcr. Iciuninr, as inuch nn 
!telcivlsiou docs. 

Internal validity is, of course, sacrificed in such a st i ly as in most: 

evaluation studios. A host of known and unknown variables are involved. 
Even if results vouJd favor one medium, no clear explanat: ion could bo provided 
nor would it be possible to sv^r.'^t xAxxch of ail the pa/tlcipatinr. variohies 
is responsible for the outcomes. This, however, could still be sufficient 
Co.- a Bummative evaluation study which, tn, Guttenhorj'. (1971) h:.s pointed 
out, involves a 'Mudgir.eni: of worlhwhilc-ness of snnic activity." 

Foxall wishes, however, to carry out an invert Ij-.-itlon into the relative 
tnerlt:R of two tcac^duii wjdll* i"^"^ ^^'^ ^'^^'^'^ BP^clfic Instructtcnal 
packages. He aimed at external validity, or r,eneralij:nbility , but because 
of poor internal validity the study fnl2ed. 

It becomes evident that sacrificing internal validity, alloxang media 
to exploit their best qtiaiities, and inovinr, ox^t of the highly controlled 
laboratory-like setting are insufficient conditions to secure reprcsenative- 



ness. 



Thus, one faces a dilemma. On tiie one hand. 

If complex behaviour is assumed to be both probalistic and 
inultidinensional, "strippinc" the environment dox^n to a 
minimum in order to control, to determine the role of a £ex^ 
variables, may he a potentially self-defeatinp, process 
(Porchum, 3971, p. '♦AS). 



A sinular arr.umcnt waH rained by Lhol (1967), Icadina hlia to conclude 
tnat the search lor cc;v--nli.:aLions haiioci on analytic ivsoaixh is futile. 

Yot, oil the other hand, 

The csnpirici:^t in education .stops with cofflpnrisou o£ 
.. grons effects. He asUa . . . vhothcr an educational . 

. filin inroducey inote leaniiiia than a verbal 
&uch sludics play a significant i^-rt in the cnfiiiieera^ 

phanci cC curriculum preparation, but rcHearch that Is 
no more than ftn empirical check on the effectiveness of 
some educatiotial package does not get to tho heart of 
the matter. One cannot generalize, for c:ianiplc, about 
the advantages of educational films. The strict empirical 
approach would force us to assess each film in turn, and, 
indeed, to test its effects when applied in each of 
several different ways. We will never ha^e cnouph 
investig-itors to carry out exhaustive studies of chi» kind, 
so that the only pr a ctical approach is to se arch for 
ex|>laruntory principles (Cronbach. 1966. p. 543, ItalicK 
added). 

Differently stated, better control over variables provides h<;.tter internal 
validity, allows better conceptualisation and understanding, but little 
rcprciicntativcness, and hence — has remote relevance to educational practice. 
On the other hand, studies in the real world of education, dealing with 
compleK variablcn, are most often hifihly specific and do not warrant 
jiem.'rali;'.atioii. Civtn also the conplo::ity of the phenomena they deal with — 
their internal validity is very poor. 



ERIC 



Thi« dilci.;:u Uau bccontc focur, «f intotent to rcnenrclwrK, and o 
uiuubc^r cl oHtr.-uH-ly i>o(.cni ,:,.Uuu!oloi>.i oa) .-.oluiiou.; Iwivc bccn surfu-sixul 
(e.ij., r.mpbclU 1969, BrachU f. Glar.s, 1968; Shuh.an. 1970; Snow, 1973; 
liuss, 1974). In the followLns p.-iges we will dir;cusr. vniys to apply soma 
of thc'uv HorullonH to racdia rcacMrch. Er.sunilally. t:.;o najor klnd« of 
research r.trat.^gicfi are nuci^esiod: Strategics to nvdvc the field «t:udy, 
concormHl with real events in tho natural setting norc 
/ .n^.-.c^vU'4 vc.\u\ ^ ^ straiegics to mke cxp-rir.ents ' more ext...nnlly 

.valid without lonin^ internal validity . 

Ir.i\>r(>vi.nn Media Resenrch in Najjm^l^ jjcn jJlP^g. 
Natural sett inr,s provide the researcher with a liost of situations, 
outstanding events, and highly innovative projects vhich dernn-ve to be 
carefully studied. Such events are particularly prominent in the world of 
media and tcchnolo-y. Their investicnti^n is important iuasmueh as their 
quality, itnntinnt! venoss and complexity far exceed the o.vent« Lyplcally 
studied by researchers. Most research concerned with innovative, yet complex, 
real-life instructional media, if conducted at all, is usually limited to 
simple evaluations that lack internal validity. The problem is therefore 

how to conduct research on real-world events, including larg^^-scale program 
evaluations as well as research into the effects of outstanding innovations^, 
while attaining satisfactory internal validity. 
The S tatist .le al Psoado-Experirnnntal pegi£i 

Salomon (1971) suggested that media research might sometimes be more 
successful if it started out tHth events In the real world and worked 
t^kwatMp into tlio laboratory by gradually analyair.g them into ever smaller 
componentr.. Karller. Shulman (1970) propouod a similar approach' labeled the 
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"lipidcii.].>n.Jiical SliMlu^.y" LO ao.cowi^lir.h the s.unt' omi for vciu'txrcli in 
tcachiur. ^iiHl loainin;:. Ksr-ml ^mUv, outooii.-s nro cor.parcd ;1f^^'r lo.-irncr;; 
have bci-u iUfferontially expo:K:cl to an cxlernal. natural, factor r.uch as a 
TV pronratn. Gathcrinr, data on niui.eroun individual dLlferonce variables 
' includinr. hackgi-ound...abilitie?!, achievement, and the. like, it .should be 
possible to dlrtinnui^l' between those who are more and those vho are less 
affected by the proi-ram. 

This sttategy needs to be suppleiiicnted by a careful aualyr.is of the 
- various components coi.a-isinji th.o program, or Che newly Introduced techno lor.y. _ 

♦ ■ 

-- Identifying, yuch sir.nificant coniponents, th.c researcher should be able to 
generate hypotheses as to their possible effects and effectiveness. He 
should thus be able to investigate not only who was wore, and who xvas less 
affected, but also whn t caus ed the effect. In this way, a real life, event 
could be studied aji_51 carefully controlled er.perimontal conditions vero 
prcFent, v;hilc in fact they were not. 

The Pseudo Experimental Design (somewhat different from ShuJmrm's 
Epidemiological Strategy) , is based on the measurement of three kinds of 
independent variables: relevant individual differences of the students involved, 
instructionally significant components of the program, and amount of student 
eKposure to ~- or involvement in the program. Students differ as to the 
amount of their uxnosurc to, or involvement in an instructional piograta — 
thus exposure is a continuous major independent variable. The purpose of 
this approach is. then, to examine the extent to which amount of exposure 
or involvement differentially affects students. Since, however, the program 
is analy^:ed into its significant components, one can also attempt to answer 
the question of what elements in the program affect individual learners. 
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It Ik-cui:;o:; ii.i-.U. lately cU'nr Lii.it tiu^ cx-^.i- h^H Km ol pror.r.'^'t':; 
cfiecU;, who.n cnrri.a uul uu.Ut nntnr.l cuaJii u-n.-:., is uu.th?<]olor.ic:n 1 y 
UolicicnU The .unount of c>:ro5n;rc to l:l!e pror.r..,. by oach Mudont r.ay l>v. 
the rcMult: of .;cir-:u.U..ctiui. Bettor nM.s more curious, norc outr.oini; 
students, may chocs., to cKpo.se themrA4ve:-'. ii^orc to the profr.-.ni. The 
iu-cc5u;ary condition of "other things bo'.n- equM" in not r.ot }mU^ 
statistical prccedurcr. are ui^cd to partially "equali5.G" the students. 
Toward ihit: end, background data needs to be collected and. nmltlple- 
rcRrer.r.ion procedures used (e.f. Cohen, 196B) . It then bcco.ues possible to 
j>artla1 ouf initial exposure- related differences. V.'e meet, to an extent, 
the comlition of "other things beinp. equal" through the l^iev^do-J^ei:^^ 
rather than through de^.ign procedures, a., will be illustrated bolox.. 
An Kxai iple 

The introduct icu of Sennnie Street to Israeli children created a unique 
opportunity to study the effects of a hi^hlv coMplex and sophisticated 
progran, on TV-naive children (Snlomon. 197/,b). Since, however, it was 
broadcasted simultaneously all over the country a traditional experlmehtal 
design became impossible. No adequate control group of children who were 
not exoected to watch the program could he formed. On the other hand, 
simple comparisons between heavy and light viewers of the program would be 
meaningless since nnjount of vieving could be the result of sclf-sclGction. 
thus threatening iutcrnal validity. 

Even if this threat"*"*^^ renioved, there was still the threat to 
external validity. Since the effects of only one program (AO one-hour 
shows) were to be studied, general inability would bo extremely limited, as 
in wost evaluation studies. The effects of one procram may not 'represent 
the possible effects of other programs. 



* ... - . , ... . • ^ , , , 

Spoclfic: HtatU:t.ir.a1 inethoarM. bou-cvor , a].lcnv» ub to ovi-rcome «uc.h 
tliffJculUon. If one vishc«« to talk about cbanr,e-a in acbicvewcnt vhich 
arc presumed to be the. rc-i^uU of pror.ratu vlcwinii, tbcu cacb cbildSi auomit 
of oxposurc to tbc pronram can be mvusuval and the dec»--^^^^ to i-xpotuiru 
Is related to later adiicvoment can bo. computed. Actually, wc have a 
situation whore the indepcudent varlablo. (cxpciure) has valuer, distributed 
over a wide raui;o: from total ron-cxponure, throush many levels of partial 
exposure, to the total expojmre of each and every show. Tn ^^^^^ ^^^^''''^ _ ^ 
wc have an advantaac over the tradi tional, cxperiiacutal def^r^n in which 
. subjects are divided into r.roupfi of "viewers" and "non-viewers." The 
tiaditioual riethod usually avoids looking into differences vii.Hvin each one 
of^tbc r,roupK» whereas here they are taken into account. 

The statistical method of Multiple Rcp'er.rAdn allow.s us to partial 
out the contributions of background and initial achievement variables, thus 

Iaea^iuring the"net" contribution of c>:posure to the progra^n to the post- 
to ,sowe extent,.^ 

Viewing achievements (e.g., Cohen, 1968). In other words, Xwe arc able, to 
specify the "not" nn-ount of post-viewing achievements which can be 
attributed to exposure, other things being equal. 

This method of analysis allows us to compare groups inasmuch ns the 
same background and pre-viewing iHoasuros are entered into the analyses in 
the same order, and exposure enter^.d rs the last predictor. It is thus 
possible to sec in which group its "net" contribution to post-viewing 

achievement is larger. 

Table 1 provides an abbreviated example of data on tt^o tests resulting 

from such an analysis. 



Table 1 about t hero 
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As can h. .kv.uiII b.rh,,,...: .i m ;> I'.ic-hU v^.^.nr uioa^iuros oc.ountcd 

lur nc.r, to 50. y 1.. tl, , l.rhin var.tano- dfiH-mlin}; on. the' • .. 

yroup nnd the ( cU . Kxpo.uV. .-K countc.a for A. 3 to A ncUmW^^^^ 

It crai alr.c. iHViuvn.that v;I.a.- <.xpo^:uro r.uh- a Kir.nif icaat di.Xletc-.uce for 

lower cl.i:;:; ch.Ma>vu in tho c of ih.= l.olter M.-achiny ter.U, it did not 

mke rmch of a d i 11 eronco for luLddle cl...sr. oni>5;. Thc> converse l.s true in 

the c.ir.o of, the Tar*':} of the Waolc le.tit. 

It hecoinos evidtur thn. tltc miilL.Iplo rc.^:rc.t^:Hon analysir. is not used " 

only as a .statiuUcil proccduri- but a» a^basic element of the le_f.i_^n. 

Without it, subjects can . trot be "equri.Ur.cd'V and the absence of a control 
group* typ.Lcr.l of rhn fUudy of ii,;txtral cv.-nts, can not be ovoreomu. 

The. question of r.encralixabili ty was treated, an wontloiuul already, 
through concopLuali/.ation of specific proiU'"« componunta followed by the 
generation of specific hypotheses. Thuy. for example. It was hypothcyii^od 
. that particular prt.Mcntation formats used in th.^ program would affect 
specific skills in particular children. Although such components could 
not be oxperimentally tnanipulafcd, it was still possible to test such 
hypotheses using multiple rer.ression procedures. 
Th e Staged Innovati on Design 

Sowetiines it way happen that a new mcdia-ba.'scd program, sufficiently 
innovative to deserve a thorough study, is introduced into schools. Let us 
assume that all students are to participate in tb.e procram. making it again 
difficult to' create adequate control groups. However, It wisht become 
possible to introduce the profiram in stages, thus allowing for a St^njied 
ll^yi}lj^lJh:jnm (f'-»nipbeU. 1969). According tt. this design not all schools 
arc Introduced to the program simultaueouply. Some schools, if l)osKible 



riUKKc.Iy ..•tss.li;n^><l/'^ are inivv6ucv.d to the projiram cnrlior thau ollwru, 
The c.n ly h^i:^nn.:L:, turn uut t.o ::crve a.>; ihc "cxiu-rincMVtal** jurouiv v'liile 
the .lALv bcKivincu-ir serve IvMi^miT^ no-trcatinent "cont rolf;." 

Achlcvc'i::c:ai.rM or nny other dependent vnrinblas, serva to corapare the 
V'>;ps-r lrv-aral'V (.^■lrly4,c^<^lnlu'r.s^ the "control" (late bo?.lnncr£5) . 

This dci;lr.n cniv be. further developed as follows: Once the "controls" 
take part in the program^ their achiavemnts can be compaied with thojsc of 
the "cxpc?rinK'iuaIu" as nieanurcd on an earlier date. Tluis a replication is 
built into the dcsli-n. Two groups jave taken part in the program, one 
after the other, and their ro£;uU« can be comparfec* on two occajsl our.: before 
the "toiitrol" r.chools started our with the pro&ram, and «i;aln — after they 
have flniiihcd it. 

One can also try to change the program before the "contror' schools ■ 
besin to participnto in it. Comparing their post-participation results 
with those of the "experimental" schools, measured on an earlier d?tc, is 
siiailur to an experimental comparison in v;hich the newly introdticed changes 
in the program serve as the "treatment." The outline of the Staged Innovation 
Design are graphically presented in Figure 1. 

***** 4* 

Figure 1 about here 



An Exaiiiple 

Elements of the Staged Innovation Design can be found in the Age Cohert 
study, part of the first year's evaluation of Sasame Street (Ball & Bogatz, 



^ If not. schools can still be cqtmlized using elements from the 
Statistical I'r.eudo Kxperiinental Design. 
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19Va). In that t;ludy, HA dii 3<li-vn/ :>3-5H tnonthr. old, were. proteGU-a 
boioiv. the pror.ram van dunvn. r.iul tht-Lr ac-hicvcmt-uts coiiipared with lhn':e. 
of another r.roup of K)l '..-hildri n of the r.amo. cij-.e, iiJU'X tlK- pronrnm va« 
shown. Khou the po.ttc.r. ^roup was dividea into vi.cvina quartilci-.. it 
vas found th.-it thor^e who vUm-d the program more nchievc-a more than the 
prot.os-t vrov?. Thus^ thr> conclur.ion was ccacbcd that vising the pronram 
lc;d to r.rc'itcr f.aiiir. in scores. 

It x,i:a be. noted that rhc: Anc Cohort reSiMiibles the Staged Innovation 
De.sinn iua.'.niuch as i.'. canpares groups at different points in tinie. Those 
who are ahout to receive the "troatncnt" servo as the controls, nnd th^^ir 
pre-"treatincnt" scores are comparc^d with the scores of another group after 
it has received tha "tre.atncnt^\j/ft 

■ f ItTVj^royins; F.y.pori montnl !-fcd Ia Research 

The major problem of experimental research oil media and technolor.y 
is, as already dlGCur,r.ed, its renwtencss from the real world of education. 
While it docs not nece^arily suffer from the absence of internal validity, 
it Xacks reprcscntatll^jp. Snow (19^) in a recent paper, discu^Hon thin 
problotn and ways to solve it in great detail. 

The bier,er.t threat to external validity, claims Snow (1973), comes - 
. . . when tlic exporincnt does not fit the nature of the 
behavior being studied and, furthermore, does not include 
the means of discovering this fact (p. 2). 
To this, it nuy be added, oxtcrnai validif:y is badly reduced when the variables 
under invest if-.^tion arc isolated . taken as discrete elements, and examined 
under relatively artificial rondttiom;. This, then, leads to the consideration 



Eculiu;i^'''l vnKd it.y concerns the extent to which the 
habitats Of Ritii:«li"UH cqinparcd in aa experiment arc 
rcp^'f-^t-'^t'^'-ivo of tho population of situations to which 
the iuv«.u;t Ii;ntoL- wislit^s to jjcncralisc (Snow, 1973, p. 10). 
The conyidcration of ecological validity needs to be complnmcuted by 
"referent generality," that is, the use of a wide ranne of possible-i'jtnrrA-- , 
B£»ti!iJL^Jtci^^l^. ^^"^^ ^^^^^ achiever^ent on one multiple-choice test). These 
tnay include both expected as well as unexpected outcones. 

Snow emunerales several ways of securing ecolor.Jcal validity and referent 
generality. Ati-.onr. those we find the observation and reeordinr. of intrn- 
cxpcrintcntnl proeenses (what do the students do. in fact, when the treatment 
is applied). cMtra-experiinental observations (how disruptive is the experiment 
wh'en initiated in midschool year), description and analysis of the students 
taklna pu-t in the study, their preparation for the experiment, the duration 
of the e:iperJniental treatment, its detailed description, and the like. 

Ef»cntlally, all this adds up to multivariate experiments, conducted 
under real life conditions, with real life treatments of more than a brief 
duration, with a wide range of dependent variables. Snow suggests a design 
by means of which one can study the interactive effects of complex treatment 
variables comprising an instructional sequence, complex learners' aptitudes 

o 

and some learning criteria.^ Figure 2 represents one version of Snow's design. 



^ The interested reader is urged to road Snow's paper (3973) for 
details and explanations, , 



The Ecological Dfsii'.n vhon itnc-d under the. conditions mentioned above, 
touia help to reduce thrc.iti: to c>:t:crnal validity, 

A HOWLVhat BimpUu- version of the EcoXogjcal Dosign nay also be approprjnte 
for weUia renearch, whore the oxpcrimdnter wishc-f; to extract some outstanding 
cjualitlcs of w-dla and study tUelv c-ffccts and ef f Gctivenef:s in interaction 
with lcur«cr<; and loc-.nuns t-'ar.ks. The researcher tnay generate specific 
hypotheses ccncer.ilng the effectJ^ oC these qualities on particular learners.^ 
jr%aj^Vy^^ fitid out for vhat kinds of tasks these are most appropriate. 

Imagine a progran wh;^ch cm be divided into a number of different tasks 
based on some learnins hierarchy, tayono'ny or a task analyr,i«. Afisume also 
that a number of ccneral and specific aptitude inenfsttres of learners are 
taken. The researcher prepares then a nu'r.ber of alternative ways of teaching 
each of the program's ta^ks such that each task (chapter, topic, or any other 
discrete component)- is taught to another group of learners using a different 
roeUium or technology. Each medium prf>parcd to teach the niatcrial in one of 
the task units is so structured as to capitalize on the special attributes 
of that Riediuia. 

Comparable groups of learners, preferably in their natural learning 
habitats, are taught the same program. However, each group is exposed to 
different taiik/medium compositions. 

The design (labeled as the Rotation Design for our present purposes) 

Ik shown in Tigure 3. 



r 
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Figuie 3 nbout here 

Vox il luMtratlvo i>tn poses we hav- put into the design four student croups, 
four lu-dia atul a foiu-tauk lenrninf, prop.ran. Other copMnal.ionn arc of 
courser pottrdblc. As it can be r.oen, each group Ic^arns the vholo, HOSTfll" 
vith a dUfcrcat ccubination of wcdia. This enables us to coripare durins* 
the-study behaviors ar, well ao posttest perfonnance within each row 
separn toly, that if;, vithin one task and across media. Given that wt: 
employ noasureii which arc coR.non to all taska (e.g. curiosity), it becomes 
possible for us to compare results within one inediura and across tasks. 
Finally, aptitude-treatment-intcractions can be studied within each row, 
thus showing whether learning of a task by means of one medium benefits 
certain learners unlike learning the task by means of another medium which 
may benefit other learners. The same analysis can be carried out within 
ona medium and across tasks and groups. 

In spite of its appearance, this is not a factorial design. No row 
or column main effects are sought after. Indeed, what could a comparison 
betwcseu the coluraiis yield? And how instructive would a row comparison be? 
The intcr-columu comparison would bo like a formative evaluation study, but 
then ~ it was not our Intention to test the overall effectiveness of an 
instructional package with this design. 

Each row in the design represents one learning task, topic or period 
of any denlrcd duration and complexity. V?ithln the row, a one-way analysis 
of variance, to test media effects, becomer, possible. This could be done 
with each row separately. However, since learning of the program is 
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liicf.ircliical ov :it UmnL rtiinulatiw, tlio rcv.-t: shotild t.ot lu- <»n.Jl v-'iMl 
inariunafnlly ot t-ach o'Jut. Thus, from the i.c-o.-ud row cn,, .ma3y>-.o.s of 
covAH.mcc (or nmUiplc r.-i:.rc.:jnicMj.-) arc cnllod for so thai, pioviouf. 
Icaniinr. — the covariaH-a ~ arc takc-n into conr.idcratlon. Tliis do.sii.n 
couia have iHH-n u^ed by Allen > W.'fntraub (3%^) rather than having ibreo 
inaepcndt.i.L »-xperinrnt.s, i-ach dealfnn ^vith a aiffereuL la.'jU. Since, 
howc-vcr, they vcre conccriK d with the inLcra^tl ion l>otwccn filmed molrton 
and task:;, ojU nhlo the icalms of a real inntrurt ional prnr.ram (t!i«^; not- 
conKldcrlpji the acrufnulation of know] cdij.c)^ their Btudy latkn 

rcprcf;cntal1vrn...;f;. The notation lH>:ar.n could ovc^reo:no thin shortccr.ning- 

Saiauels/ Ulesbrocl-. Terry (l<i7''0 v.-it;hcd lo detcri.ilnc whether pictarini 
illuslratiunr. vould influence bej-inniui; vci Icrr.' attittidcu toward f:toricf; 
they read. Sotic of nhe psycholoi. f ral efrcetf. of lUuRtrationi- when uned 
in primry rcadcrn were iiivci^t ir.atod earlier, indicating strong interference 
effects (Saii.uclc, 1970). Thus, the presfci:>,t »tiu!y was concerned mainly %^ith 
affective effects and their instructional utility. Using a Graeco Latin 
Square Repeated Measurer. Design, the rescarchern assigned students to one 
of three firoups. Each i^roup read one story each day for three days. Each 
story was aceonp:.nied by a different type of iilustrationr,. Thus, no tvo 
groupu read the same story with the sane illuntrationr.. nor did two p.roiips 
* read the same story on the saiae day. 

The design used by Sar.ueli; ct al. differs only slir.htly from the 
notation i>ef;ir,n. The i:iajor difference lies in the fact that no particular 
order of stocy-pre.-.entn! ion was needed, wherens the Rotation Pesir.n better 
tiuited to deal with ruriicula in which cbapier or topic order is jUven. 



•Hu. ai,a:co-I.at iu Square dr<:tr.u as ur. t by Sarnu lr. ft al. i\vi-A uol consider 
Jut.nutlun..; vitl. indivh;...! dinrt.iur-:. tn tlu' Kctnlion iJrslr.u this it; 
a critical coi;-.i..mcut. Yet:, lii or.U.o of tl.e«a cUfrcTciiucH the tv;o dcut nun 
aprrur to lK> raUuT 1 .,r inar.t..nH» as both cU-.'U with all posnlMe n.-dia/Lask 
W.lnatlfnv. nud both can bo carried out in nntnrnl ^ctt iiir.r.. 

Suinn jary 

RuseavcU on Keaia aiidVcluiolony in Kducation appears in many forms 

U)d tiiyles. Hovevcr, its yield in terias of understanding ?s.-dia. S"itIi»C 

their utilLiiaLlon, or iuprovinc education vas, and still is, quite 
dir.nppoiutlng. A numbar ol critics have Bhoxm the inadequacy of groBS r.iedia 
conpa.-iHons. and bavc pointed to the difference bet^^cen research on ii.edia 
and rcf-carch with i.^edia. Media attributes, ratber than niodia per 55c. were 
dealt- with and a ntronc need for ccnceptuali^iing these attributes in tcrm« 
of U.eir cffccu^ and functicua was f;uiiac.sted. This has led to more npeciflc 
and iJophiBLicated rcftoarch questions, concerned vith media x task x learner 
interactions, to replace the questions about the universal tneriVs of JDodla. 

However, tlie iv.ore Bpeclfic the questions became, the more the research 
moved away from the real world of education, in spite of the promise for 
better conceptualiual ion 'and theory. The research bccntnu hifihly specific, 
neat, even sterile to a dei^rec, thus increasingly losing represcntaHlveneas. 

A clear conflict between better control over specific varinbles and 
representativeness (that is, relevance to the real world of education) could 
be feU. A number of solutions were sur.r.i'«tcd. These pertained particularly 
tc tv;o Instances: first, to studies conducted In natural wottluRS 
Innovative Kiedla prournius which usually suffer from the absence of Internal 
validity, and to wi-n-controlled experimMUs nufferlnr.. as iudicntcd, frcim 
poor external valid fty or representatl veneoo. 



As for Uie ficlwl stvtdJos fvo d.-f-.i^n? v. rt- (li?(iuu:;ua . 'TUe Hrnt . the 
StaLiiitUal l'5;vudo-i:;.iH>ri!.oaial. IK-r.Iy.n. ir. ba:u-tl on the ur.v of L-iuIt.iple 
rc.r.rc»»iua«. U cnahlvs im to conduct larrv-r.c.iU- rcnc-arch ou the cffucls 
oi a program, wM.hout ci>mrol groups, while i;liU maklnij It possTM(^ to 
CHtitnatc effect, interactions and causes for thonc. In spUc of tlio absence 
of experimental controls, this dcfdnn enables us. uivtni certain provi id ous» 
to lauintaln satisfactory internal validity. Seeoml was the Staged 
Innovation DtF.im, which allowK inter-sroup compariPonH vhcn a program Is 

introduced in stageu. 

•JVo designs were also suc.geftted for o>;peri mental research; the Rotation 
Design was offered to suppletaent other newly dev,-loped multivariate dealans 
discust;ed in the current literature. That der, I r.n onahlo.n us to Bttidy the 
interactions of media, tasks and learnors in real life settings, taking 
into consideration the complexity of the educational setting as x^ell as 
the accumulation of knowledge. Tlie Ecological Design was offered as a 
raethod of including a wide range of situational and content variables, and 
A similarly wide range of media altdbutes. in an experimental strurture. 

Tho designs discuased herein somewhat blur the distinction between the 
traditional types of fflodia research mentioned in the opening section. For 
instance, evaluation studies can be oo conceplualiRud and deBigncd as to 
answer also questions pertaining to the effectr.. and not only the effectiveness 
of a media program. Similarly, eKpcrlfnfntal ntudlew, orlf^i^^lny dcstguud 
to deal with psychological effects of speeiiic media attVibutVi^, can bn 
laado to deal ali^o with questions of inntvuctloual ef f ectivcmcns In tho mil 

world of education. 

llie major thrnio thus is, that by moving media teuottVt;U out hi it« 
traditional i-iJier-lnternal-or-external-valldtty conflict, bettor and aiorc 
ftuttftii research could emerge. 
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. Figure 1 : THE STAGED INNOVATION DESIGN 
(After CampboU, 1969) 
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Figuro 2 : THU tCOlOGlCAl DCLUGrvl 
(bwsCiH on Snow, 19/r>) 
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Fitjure3. THE ROTATtOW DESIGN 

(task X medium x luarners expoiimunt) 
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